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[TITLE OF DOCUMENT] SPECIFICATION 

[TITLE OF THE INVENTION], AUTOMATIC SURVEY SYSTEM 
[WHAT IS CLAIMED IS;] 

[Claim 1] An automatic survey system^ comprising: 

a survey means for conducting a survey; 

a co-line calculation means which determines, as a co-line, 
a straight line that regulates collinear conditions with respect 
to points arbitrarily specified in a survey image of a survey 
site having a Icnown positional relationship with the survey 
means; 

a collimation direction control means which controls the 
survey means to move in a collimation direction of the survey 
means along the co-line; and 

an object point search means that searches for positions 
of object points to be surveyed at which the object points are 
on the co-line by conducting a survey in the collimation 
direction by using the survey means during driving of the 
collimation direction control means, wherein 

the positions searched by the object point search means are 
ob j ect points corresponding to the specified points on the survey 
image. 

[Claim 2] The automatic survey system according to Claim 1, 
wherein the automatic survey system further comprises a 



-1- 



positional relationship calculation means that calculates a 
positional relationship between the survey means and the survey 
image/ and the positional relationship is calculated from a 
relationship between survey data of three or more arbitrary 
set reference points and positions of the reference points on 
the survey image. 

[Claim 3] The automatic survey system according to Claim 2, 
wherein the automatic survey system further comprises an input 
means for specifying positions on the survey image, and the 
positions of the reference points are determined by specifying 
arbitrary positions on the survey image by the input means. 
[Claim 4] The automatic survey system according to Claim 1, 
wherein the automatic survey system further comprises an input 
means for specifying positions on the survey image , and arbitrary 
points on the survey image to become targets to be searched 
for by the object point search means are specified by the input 
means . 

[Claim 5] The automatic survey system according to Claim 4, 
wherein an arbitrary straight line or curved line on the survey 
image can be specified by the input means, and the object point 
search means searches for a plurality of points along the 
straight line or curved line. 

[Claim 6] The automatic survey system according to Claim 4, 
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wherein an arbitrary closed curve on the survey image can be 
specified by the input means ^ and the object search means 
searches for a plurality of points within the closed curve. 
[Claim 7] An automatic survey system, comprising: 

a positional relationship calculation means that calculates 
a positional relationship between a coordinate system as a 
reference of survey data of survey points and a survey image 
of a survey site including the survey points; 

an associating means that associates the survey point survey 
data with position data of positions on the survey image 
corresponding to the survey points; 

an input means for specifying positions of survey points 
on the survey image; and 

a collimation direction control means that controls a 
collimation direction of a survey means based on the positions 
of the survey points on the survey image specified by the input 
means. 

[Claim 8] The automatic survey system according to Claim 1 , 
wherein the survey image is taken by setting a projection center 
of an imaging optical system at a position optically equivalent 
to a collimation origin of the survey means, the collimation 
direction control means calculates angle data of a collimation 
point in the coordinate system based on two-dimensional position 
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dat:a of the collimation point whose position is specified on 
the survey image by the input means and external orientation 
elements of an imaging device that has taken the survey image ^ 
and collimates the survey means in a direction corresponding 
to the angle data. 

[Claim 9] The automatic survey system according to Claim 8, 
wherein when the survey point survey data is predetermined 
geographic data including set survey points^ the survey points 
are indicated on the survey image based on three-dimensional 
position data of the survey points^ a survey point specified 
by the input means among the survey points is set as the 
collimation point and collimation of the survey means is 
controlled. . 

[Claim 10] The automatic survey system according to Claim 9, 
wherein the indication of the survey point on the survey image 
after colldLmation is changed. 

[Claim 11] The automatic survey system according to Claim 1 , 
wherein the collimation point is indicated on the survey image. 
[Claim 12] The automatic survey system according to Claim 11, 
wherein after collimation of the survey means to the collimation 
point / the indication of the collimation point on the survey 
image is changed. 

[DETAILED DESCRIPTION OF THE INVENTION] 
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[0001] 

[Field of the art] 

The present invention relates to a survey system using a 
surveying instrument. 
[0002] . 
[Prior Arts] 

Normally^ a survey is made by a pair of operators^ including 
an operator who holds a reflecting target such as a prism at 
a survey point to be surveyed , and an operator who operates 
the surveying instrument • In such a surveying work, the operator 
who holds the target must move his location for each survey 
point, and each time, the operator who operates the surveying 
instrument must perform a colldLmating operation to the target. 
Therefore, the surveying work is very troublesome and high in 
cost since requires manpower and time. Recently, a non-prism 
type surveying instrument that does not require a reflecting 
target such as a prism is also available. The non-prism type 
surveying instrument does not require the operator who holds 
the target and can conduct a survey by only an operator who 
operates the surveying instrument, whereby making the work 
efficient. However, even with the non-prism type surveying 
instrument, the operator must perform a collimating operation 
of the surveying instrument for each survey point . Particularly, 
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when the number of set points to be surveyed is large as in 
such a case where the capacity of a depression into which sediment 
is deposited is estimated, the work takes a long time and places 
a great load on the operator. 
[0003] 

[Objects to be Solved by the Invention] 

An object of the invention is to improve the working efficiency 
in a survey. More specifically, the object of the invention 
is to easily and efficiently associate survey data obtained 
by a surveying instrument with image data obtained by a camera, 
control collimation of the surveying instrument based on the 
image data, and conduct automatic surveys. 

[0004] 

[Means for Solving the Problem] 

An automatic survey system of the invention comprises: a 
survey means for conducting a survey; a co-line calculation 
means which determines, as a co-line, a straight line that 
regulates collinear conditions with respect to points 
arbitrarily specified in a survey image of a survey site having 
a known positional relationship with the survey means; a 
collimation direction control means which controls the survey 
means to move in a collimation direction of the survey means 
along the co-line ; and an ob j ect point search means that searches 
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for positions of object points to be surveyed at which the object 
points are on the co-line by conducting a survey in the 
collimation direction by using the survey means during driving 
of the collimation direction control means, wherein the 
positions searched by the object point search means are object 
points corresponding to the specified points on the survey image . 
[0005] 

Preferably, the automatic survey system further comprises 
a positional relationship calculation means that calculates 
a positional relationship between the survey means and the survey 
image, and the positional relationship is calculated from a 
relationship between survey data of three or more arbitrary 
set reference points and positions of the reference points on 
the survey image. Thereby, the positional relationship between 
the survey means and the survey image can be easily obtained, 
so that automatic surveys can, always be easily conducted. To 
more easily obtain the positional relationship, preferably, 
the automatic survey system comprises an input means for 
specifying positions on the survey image, and the positions 
of the reference points are determined by specifying arbitrary 
positions on the survey image by the input means. 

[0006] 

In addition, preferably, an arbitrary point on the survey 
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image as an object to be searched for by the object point search 
means can be specified with the input means. In this case, an 
arbitrary straight line or curved line on the survey image can 
be specified by the input means, and the object point search 
means searches for a plurality of points along the straight 
line or curved line. Or, an arbitrary closed curve on the survey 
image can be specified by the input means, and the object search 
means searches for a plurality of points within the closed curve . 
Thereby, an operator can automatically obtain a large amount 
of survey data regarding a curved line and a region only by 
specifying the curved line (straight line) and region, whereby 
making the survey work remarkably efficient. 
[0007] 

Furthermore, an automatic survey system of the invention, 
comprises: a positional relationship calculation means that 
calculates a positional relationship between a coordinate 
system as a reference of survey data of survey points and a 
survey image of a survey site including the survey points; an 
associating means that associates the survey point survey data 
with position data of positions on the survey image corr:esponding 
to the survey points; an input means for specifying positions 
of survey points on the survey image; and a collimation direction 
control means that controls a collimation direction of a survey 
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means based on the positions of the survey points on the survey 
image specified by the input means. 
[0008] 

The survey image is taken by setting a projection center 
of an imaging optical system at a position optically equivalent 
to a collimation origin of the survey means (for example , 
mechanical center of TS or ETH), the collimation direction 
control means calculates angle data of a collimation point in 
the coordinate system based on two-dimensional position data 
of the collimation point whose position is specified on the 
survey image by the input means and external orientation elements 
of an dLmage pickup device that has taken the survey image, and 
collimates the survey means in a direction corresponding to 
the angle data. In this case, the horizontal angle and the 
elevation angle can be directly calculated from the image 
coordinates of the collimation point on the survey image , whereby 
making the processing simpler. 

[0009] 

When survey data of survey points are known, for example, 
the survey points are indicated on a survey image based on 
three-dimensional position data of the survey points, and a 
survey point specified by the input means among these survey 
points is set as a collimation point and collimation of the 



survey means is controlled. Thereby^ even in the case of 
collimatioh to a survey set point whose survey data is provided 
in advance for survey set operations, or in the case of 
re-collimation to a survey point that has already been surveyed, 
the survey means can be easily collimated to the target survey 
point . 
[0010] 

Furthermore, preferably, the automatic survey system 
indicates the collimation point on the survey image, and 
preferably, after collimation of the survey means to the 
collimation point, the indication of the collimation point on 
the survey image is changed. Likewise, it is preferable that 
the indication of the survey point on the survey image is changed 
after collimation. Thereby, the operator can easily visually 
recognize that the survey means has been collimated to a target 
survey point. . 

[0011] 

[Preferred Embodiments of the Invention] 

Hereinafter, an embodiment of the invention is explained 
with reference to the drawings. 

Fig. 1 is a block diagram showing an outline of a survey 
system using a surveying instrument and a camera according to 
an embodiment of the invention. 



-10- 



[0012] 

The surveying instrument is, for example, a total station, 
whichjias a collimating telescope 17 for collimation to a survey 
point. The collimating telescope 17 has a horizontal axis Lh 
for elevating the collimating telescope to measure an elevation 
angle 0p and a vertical axis Lp for rotating the collimating 
telescope horizontally to measure a horizontal angle Qh, and 
is rotatable around these axes . The horizontal axis Lh and the 
vertical axis Lp cross at right angles at a point Os ( hereinafter , 
referred to as a collimation origin Os), and the optical axis 
(collimation line) of the colldLmating telescope 17 pass through 
the collimation origin Og. The optical axis LNo is divided into 
two by the half mirror 18, and one is guided to an eyepiece 
* lens and the other is guided to a rangefinding portion 11. 

[0013] 

The rangefinding portion 11 detects a slope distance, etc., 
to a collimated survey point by, for example, an electro-optical 
range finder, and an angle measuring/angle controlling portion 
12 detects a horizontal angle 0h and an elevation angle 6p in 
this case. The collimating telescope 17 can be rotated around 
the horizontal axis Lh and the vertical axis Lp by an 
unillustrated stepping motor, etc., and these rotations are 
controlled by the angle measuring/angle controlling portion 
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12. 

[0014] 

The rangefinding portion 11 and the angle measuring/angle 
controlling portion 12 are respectively connected to a system 
control circuit 13^ and are controlled based on an instruction 
from the system control circuit 13 • For example, the rangefinding 
portion 11 performs rangefinding based on an instruction from 
the system control circuit 13, and transmits a measured value 
to the system control circuit 13. On the other hand, the angle 
measuring/angle controlling portion 12 always measures the 
angle and transmits the measured value to the system control 
circuit 13 in response to a request from the system control 
circuit 13, and drives the stepping motor to control the 
rotations around the horizontal axis Lh and the vertical axis 
Lp. The measured values of the detected slope distance, 
horizontal angle, and elevation angle, etc., are processed by 
the system control circuit 13. To the system control circuit 
13, a switch group 14, a display 15 (for example, LCD), an 
interface circuit 16, etc., are connected in addition. 

[Q015] 

To the interface circuit 16, a computer 40 such as a notebook 
personal computer is connected via an interface cable. Namely, 
the surveying instrument 10 can transmit survey data, etc.. 
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to the computer 40 via the interface cable. The surveying 
instrument 10 can also be controlled based on a control signal 
from the computer 40, and for example, the collimation direction 
of the collimating telescope 17 (horizontal angle Oh and 
elevation angle 9p) can be controlled from the computer 40. 
The interface circuit 16 can also be connected to a peripheral 
device such as a data collector (not shown). 
[0016] 

The computer 40 mainly comprises, centering around a CPU 
41, a recording medium 42 such as a hard disk, DVD, MO, or IC 
card, an input device such as a mouse 43 and a keyboard 44, 
an image display device (monitor) 45 such as an LCD or CRT, 
and an interface circuit 46. As described above, the interface 
46 is connected to the interface circuit 16 of the surveying 
instrument 10 via the interface cable. The interface circuit 
46 is connectable to, for example, a digital still camera 20. 
Namely, an image taken by the digital still camera 20 is 
transmitted to the computer 40 as digital image data and recorded 
on the recording medium 42 via the interface circuit 46. 

[0017] 

Next, a single photograph orientation processing in a survey 
system of the embodiment is explained with reference to Fig. 
1, Fig. 2, and Fig. 3. Fig. 2 is a flowchart of single photograph 
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orientation processing in the survey system of the embodiment^ 
and Fig . 3 is a conceptual diagram of arrangement of the surveying 
instrument and a digital still camera when a survey view of 
a survey site is taken by the digital still camera. 
[0018] 

First, at Step SlOl, an operator takes an image of the survey 
view of a survey site with the digital still camera (DSC) 20, 
transmits the taken digital image to the computer 40 via the 
interface cable, etc., and records it on the recording medium 
42 • The taken digital image (survey image) includes a plurality 
of survey points to be surveyed. 

[0019] 

At Step SI 02, the taken survey image is displayed on, for 
example, a monitor 45 of the computer 40 . In this case, a plurality 
of points (pixels) in the displayed survey image are selected 
by using a pointing device such as a mouse 43 by the operator. 
Thereby, object points in the real space corresponding to the 
thus selected pixels are specified as reference points Pi (i=l, 
2..., n) (reference points are survey points to be used for 
calculating a positional relationship between the survey image 
and survey data) . The positions of image points Pi ' on the survey 
image corresponding to the respective specified reference 
points Pi are calculated as two-dimensional image coordinates 
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(xpi' , ypi' ) . The jLmage coordinate system is a two-dimensional 
coordinate system that has an origin set at the upper left of 
the image and is positive downward of the y' axis. The number 
n of reference points is, for example , 11 or more, 
three-dijnensionally arranged* 
[0020] 

At Step SIC 3, a slope distance and angles (elevation, 
horizontal) of each reference point Pi specified at Step S102 
are measured by the operator by using the surveying instrument 
10, and the measured values are transmitted to the interface 
circuit 46 of the computer 40 via the interface circuit 16. 
The CPU 41 calculates the three-dimensional coordinates (Xpi, 
Ypi, Zpi) of each reference point Pi in a predetermined survey 
coordinate system. In this case, the survey coordinates (Xpi, 
Ypi, Zpi) of the reference points Pi are respectively associated 
with the image coordinates (xpi ' , ypi ' ) of the image points Pi ' , . 
In the emboddLment , in the survey coordinate system, for example, 
the collimation origin Os of the surveying instrument 10 is 
set as an origin, however, it is also possible that an absolute 
coordinate regulated by the Geographical Survey Institute or 
a coordinate system arbitrarily determined at the survey site 
is used. In addition, it is also allowed that the surveying 
instrument 10 calculates the survey coordinates and transits 



these to the computer 40. \ 
[0021] 

At Step S104, as described later, external orientation 
elements that indicate the position and inclination of the 
digital still camera 20 when taking the survey image and internal 
normal position elements for correcting deviations of co^line 
conditions due to lens distortion or eccentricity of a principal 
point from the image center are calculated by, for example, 
the spatial resection backward intersection method from 
association between survey coordinates with respect to the 
respective reference points Pi and image coordinates. Namely, 
a position (Xo/ Yo, Zo) of the origin Oc of the three dimensional 
camera coordinate system fixed to the digital still camera 20 
in the survey coordinate system and the rotation angles (co, 
<j), k) around the X axis, y axis, and z axis of the camera coordinate 
system when taking the image are. calculated as external 
orientation elements, and camera internal normal position 
elements (f : distance from the lens projection center to the 
image surface (image distance); D2, D4/ and De: distortion 
two-dimensional, four-dimensional, and six-dimensional 
components; Pi and P2: distortion asymmetrical components; and 
Xc and Yc: eccentric amounts of the principal point from the 
image center) are calculated. Thereby, the projection 
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relationship between the image coordinates and the survey 
coordinates is established. When the internal normal position 
elements are set to (f , D2/ D4/ De, Pi/ P2/ Xc/ and Yc) described 
above, the number of reference points necessary for calculating 
the external orientation elements and internal normal position 
elements is 7 or more. Among these, the number of reference 
points necessary for calculating the external orientation 
elements {Xo, Yo/ Zo/ co, ^, k) is 3 or more. In the embodiment, 
11 (or more). points are specified as reference points for 
external orientation and internal orientation. 
[0022] 

The camera coordinate system is a right-handed coordinate 
system having an origin Oc set at the lens center (projection 
center), and its x axis and y axis are in parallel to the s' 
axis and the t' axis of a screen coordinate system, and the 
z axis is perpendicular to the imaging plane and defined toward 
the image surface. Namely, points on an imaging surface are 
expressed by (x, y, f ) . Herein, the screen coordinate system 
is a two-dimensional coordinate system on the imaging surface 
having an origin set at the principal point, and the s' axis 
corresponds to the horizontal line direction of an image pickup 
device 21 and the t' axis corresponds to the vertical line 
direction (see Fig. 4). 



-17- 



[0023] 

After the processings of Step SlOl through Step S104^ the 
single photograph orientation processing of the embodiment is 
ended. It is also possible that a survey image taken before 
is used instead of taking an image of a survey site at Step 
siOl. In the embodiment^ the single photograph orientation 
processing is explained with reference to the flowchart of Fig, 
2, however^ it is also possible that a survey of the reference 
points at Step S103 is made first and then Step SlOl and Step 
S102 are per formed. As reference point survey data, data surveyed 
before and predetermined geographic data (including 
triangulation points provided by the Geographical Survey 
Institute and geographic data of maps avalable on the market) ' 
can be used. 

[0024] 

Next, with reference to Fig. 4 and Fig. 5, the principle 
of the method of calculating external orientation elements and 
internal normal position elements by means of the spatial 
resection backward intersection method of the digital still 
camera 20 in the embodiment (Step S104) is explained. 

[0025] 

Fig. 4 is a schematic diagram of the relationship between 
three reference points Pi, P2, and P3 and image points Pi ' , P2' , 
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and P3' on the imaging surfaces S of these. Fig. 5 is a flowchart 
of a program of the spatial resection backward intersection 
method to calculate the external orientation elements (Xq, Yq, 
Zo, CO, <(>, K) and camera internal normal position elements (f , 
D2/ D4/ Der Ni, N2/ Xcf Yc) that indicate the position and 
inclination of the digital still camera 20 at Step S104 of Fig. 
2, and for calculating , these, successive approximation method 
using the least squares method is used. In the embodiment, as 
described above, the number of reference points is any number 
as long as it is equal to or more than 7, however, herein, the 
case where 11 reference points are specified is explained as 
an example. Fig. 4 shows only three points Pi, P2, and P3 of 
these points. 
[0026] 

First, at Step S201, as approximate values to external 
orientation elements (Xo, Yo, Zof co, <)), k) and internal normal 
position elements (f , D2, D4, De, Ni, N2f Xc/ Yc) indicating the 
position and inclination of the camera,^ appropriate initial 
values (Xgo/ Ygo/ Zgo^ coq, ^g, Kq) and (fc, D2G, D4G/ ^eo, Nig, N2g^ 
XcG/ Ycg) are provided. Next, at Step S202, by using the provided 
external orientation elements (Xgo/ Ygo/ Zgo/ o>g/ <|>g/ kq) and 
internal normal position elements (fc/ D2G/ D4G/ Dsg/ Nig, N2G/ 
XcG/ Ycg) / approximate image coordinates (xpGi', ypci') of image 
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points Pi' corresponding to the respective reference points 
Pi are calculated from the survey coordinates (Xpi, Ypi, Zpi) 
of the 11 reference points Pi (i=lf 2..., 11). 
[0027] 

Namely, the coordinates (xpi, ypif zpi) of the reference points 
Pi (i=lf 2..., 11) in the camera coordinate system are calculated 
by the following equation (1) from the coordinates (Xpi, Ypi, 
Zpi) in the survey coordinate system, so that by substituting 
the approximate external orientation elements (Xcof Ygo, Zgo, 
c«G/ <t>G/ Kg) and the survey coordinates (Xpi, Ypi, Zpi) of the 
reference points Pi into the equation ( 1 ) / the approximate camera 
coordinates (xpci, ypci/ zpci) of the reference points Pi can 
be calculated. 
[Numerical formula 1] 
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YPi - Yo 
ZPi - Zo ) 



(1) 



Herein, the matrix {Tjjc} is a rotating matrix, and each component 
Tjk is expressed by, for example, the following equations 

Tii= COS<|) • COSK 

Ti2= coso) • sinK+sino • sin(|> • cosk 
Ti3= sinco • sinK - cosco • sincj) • cosk 
T2i= -cos<|> • sinK 
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T22= costo • cosK - sinco • sin^) • sinK 
T23= since • COSK + cosco • sin<() • sinK 
T3i= sin<t) 
T32= -sinco • coscj) 

T33= cosco • COS(|> 

[0028] 

The screen coordinates ( spi ' , tpi ' ) before being corrected 
by using the internal normal position elements of image points 
Pi ' corresponding to the reference points Pi are calculated by 
the following equations ( 2 ) by using the external orientation 
elements (Xo, Yo, Zq, co^ cj)^ k) and the camera coordinates (xpi, 
ypi, zpi) of the reference points Pi from collinear conditions 
in that the taken reference points / pro jection center , and image 
points thereof are on the same straight line. 
[Numerical formula 2] 

,p.i^f 2EPi = f T,i(Xp^ - Xq) + Ti,(Ypi - Yq) + T,3(ZPi - Zq) 

'^^i_f yPi _ f 1^l(XPi - Xq) + T^,(YPi - Yq) + %^{ZP^ - Zq) ^ 

zPi ^i(XPi - Xo) + T^2(YPi - Yo) + 1^3(ZPi - Zo) 

[0029] 

The screen coordinates ( spi ' , tpi ' ) before being corrected 
are influenced by distortion, etc., however, these are corrected 
by substituting the screen coordinates (spi', tPi') of the 
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respective image points Pi' and approximate internal normal 

position elements (fc, D2G/ D4G/ Dec/ Nig/ N2Gf Xcg/ Ycg) into the 

equations (3). Namely, by the equations (3), the approximate 

screen coordinates. (scpi', tcpi') after being corrected are 

calculated. 

[Numerical formula 3] 

R2=spi^^-i-tpi^^ 

scpi ' =spi ' ( 1+D2R^''D4R^'^D6R^ ) + ( R^+2 spi ' ^ ) Ni-H2 spi ' tpx ' N2+Xc 
tcpi'=tpi' ( l+D2R^^D4R^^D6R^)+2spi'tpi'Ni+(R^+2tpi'^)N2+Yc (3) 
[0030] 

The approximate image coordinates ( xpci ' / ypci ' ) of the image 
points Pi' are calculated by substituting the corrected 
approximate screen coordinates ( scpci ' / tcpci ' ) into the 
following equations ( 4 ) • 
[Numerical formula 4] 
xpi'= scpi'/(-Px)+W/2 
ypi'= tcpi'/Py+H/2 (4) . 

Herein, Px and Py indicate horizontal and vertical pixel pitches 
of the CCD, respectively, and W and H indicate the numbers of 
pixels in the horizontal direction and the vertical direction 
of the image. 
[0031] 

At Step S203, a merit function <1> for judging whether the 
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approximately provided external orientation elements (Xgo, Ygo/ 
Zgo/ <|)g/ Kg) and internal normal position elements (fc/ D2g^ 
D4G/ Dec/ Nig f N2G, Xqg f Ycg ) are appropriate is calculated. The 
merit function <I> is defined by, for example, the equation (5) . 
[Numerical formula 5] 

^ = 2 - xp^/f + (yPi' - yPGi^f J (5) 

Namely, in the embodiment, the merit function 4> corresponds 
to the square of the distance between image coordinates (xpi ' , 
ypi ' ) of the image points Pi ' of the reference points Pi specified 
on the survey image and approximate image coordinates (xpci', 
xpci ' ) of image points Pi ' determined from the survey coordinates 
(Xpi, Ypi, Zpi) of the reference points Pi determined by a survey 
and the approximately provided external orientation elements 
(Xgo/ Ygo/ Zgo/ cod, Kg) and internal normal position elements 
( f G f D2G / D4G / Dec / NiG f N2G f XcG / Ycg ) • 
[0032] 

Next, at Step S204, it is judged whether the merit function 
<1> is smaller than a predetermined value. Namely, it is judged 
whether approximate image coordinates (xpci', ypci') of image 
points Pi' according to the approximately provided external 
orientation elements (Xgo/ Ycof Zgo/ a>G/ ^Gf kq) and internal normal 
position elements (fcf D2G/ I>4g/ Dsg/ Nig/ N2G/ Xcg^ Ycg) are 
sufficiently close to the image coordinates (xpi ' , ypi ' ) of image 
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points Pi' of the reference points Pi specified on the survey 
image. When <I> is. smaller than the predetermined value^ this 
processing is ended, and the currently provided external 
orientation elements (Xcor Ygo/ Zgo/ <OGf <|>g/ kq) and internal normal 
position elements (fc/ D2G/ D^Gf Dsg, Nig/ N2G/ Xccf Ycg) are used 
as external orientation elements and internal normal position 
elements indicating the camera position and inclination when 
it takes the survey image. 
[0033] 

On the other hand, when it is judged <I> is as equal or larger 
than the predetermined value at Step S204, correction amounts 
(6X, 6Y, bZ, 6co, b^, 6k, 6f, 6D2, 6D4/ SDg/ 6N1, 6N2, 6Xc, 6Yc) for 
the approximately provided external orientation elements (Xgo/ 
Ygo/ Zgo/ o\3/ 4>g/ Kg) and internal normal position elements (fG, 
D2G/ D4Gf Decf NiG/ N2G/ XcG/ Ycg) are calculated by, for example, 
the least squares method at Step S205. Namely, (scpi', tcpi') 
of the equations ( 3 ) are substituted for ( spi ' , tpi ' ) as collinear 
conditions in the equations ( 2 ) , Taylor-expanded around the 
approximate external orientation elements (Xgo^ Yqo/ Zgo/ cog/ 
<|)Gr Kg) and internal normal position elements (fG, D2Gf D4Gf DeG^ 
NiG, N2G/ XcGr Ycg) / and linearized by omitting high-order terms. 
In this linearized equation, a normal equation in that the 
correction amounts (6X, 6Y, 6Z, 6cd, 64), 6k, 6f, 6D2, 6D4, SDe, 
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6Ni^ 6N2/ 8Xcf 8Yc) are unknown amounts is created to calculate 
proper correction amounts (6X, 8Y^ bZ, 8(o, 6<j)^ 6k, 6f , 6D2/ 8D4, 
bDsf 8N2, 6Xc, 6Yc). 

[0034] 

At Step S206/ based on the correction amounts (6X, 6Y, bz, 
6a), 6<|), 8k, 6f, 8D2/ 8D4, SDe, 8N1, 8N2, 6Xc, 8Yc) calculated at 
Step S205, the approximate external orientation elements (Xgo/ 
Ygo/ Zgo/ cofe/ <t>G/ Kg) and internal normal position elements (fc, 
D2G/ D4G/ Dec/ NiG/ N2G/ XcG/ Ycg) are updated. Namely, the respective 
values of (Xcor Ygo/ Zgo/ <t>G/ Kg, for ^2Gf D^Gr Dec/ Nig, N2G/ 

XcG/ YcGf ) are substituted with (Xgo+6x, Ygo+8y, Zgo+8z, (OgH-6(o, 

<|)G+8<j), Kg+8k, fG+8f , D2G+6D2, D4G+6D4, D6G+6D6, N1G+8N1, N2G+6N2, XcG+8Xc, 

Ycg+8Yc), whereby the camera position and internal normal 
positions are updated. Thereafter, the process returns to Step 
S202 , and Steps S202 through S206 are repeatedly performed until 
0 is judged as smaller than the predetermined value at Step 
S204. 

[0035] 

Next, with reference to Fig . 1, Fig. 6, and Fig. 7, the outline 
of the automatic survey processing in the survey system of the 
embodiment is explained. 

[0036] 

Fig. 6 shows a survey image of a survey site displayed on 
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the monitor 45 . The operator determines a region ( survey region ) 
A to be surveyed on the survey image by operating a mouse cursor 
by, for example, the mouse 43. As shown in Fig. 7, the computer 
40 calculates a straight line . (hereinafter , referred to as 
co-line) LNc with respect to an arbitrary pixel (image point 
Qs' corresponding to object point Qe) within the survey region 
A. The surveying instrument 10 conducts a survey at predetermined 
intervals (for example, points Ri through R5) while scanning 
the co-line LNc (movement while intersecting the collimation 
line LNo with the co-line LNc ) / and the object point Qe is searched 
by referring to survey coordinates obtained when the surveying 
instrument 10 is directed toward the respective points Rj ( j=l, 
2..., 6). This is performed for all pixels in, for example, the 
survey region A. It is also possible that the survey region 
A is automatically divided into grids at arbitrary intervals 
(for example, equal intervals) and the search is made for each 
grid point. It is also possible that a curve B is specified 
and the curve is automatically divided at arbitrary intervals 
(for example, equal intervals). The survey region A and the 
curve B are both specified by a person who conducts a measurement . 
The arbitrary intervals can be set to equal intervals by angles 
of the surveying instrument. The survey region A and the curve 
B can be created by detecting an arbitrary specified color range 
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or brightness range by applying image processing to the survey 
image, or created by edge detection, etc. 
[0037] 

For example, when the surveying instrument 10 is directed 
toward the point R2 on the co-line LNcf the position of the object 
point Q2 out of the survey region is measured by the surveying 
instrument 10. Therefore, by substituting the external 
orientation elements (Xo, Yo, Zo/ co, ^, k) and internal normal 
position elements (f , D2f D4, De, Ni, N2, Xc, Yc) calculated by 
the single photograph orientation processing and the measured 
survey coordinates (Xq2, Yq2, and Zq2) of the object point Q2 
into the equations ( 1 ) through ( 4 ) , the image coordinates ( Xq2 ' , 
yq2' ) on the survey image corresponding to the object point Q2 
are calculated. The object point Q2 is different from the object 
point Qe corresponding to the specified image point Qe ' / so that 
the image coordinates (Xq2 ' / yq2 ' ) corresponding to the measured 
object point Q2 are different from the image coordinates (Xqe' , 
yqe') of the object point Qe'. 

[0038] 

On the other hand, the point Re on. the co-line LNc is an 
intersection between the co-line LNc and an object within the 
survey region, and matches the object point Qe. Namely, the 
image coordinates calculated from the survey coordinates 
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measured when the surveying instrument is directed toward the 
point Re are equal to the image coordinates (Xqe'r Yqe ' ) of the 
specified image point Q6 ' . Therefore^ a survey is made along 
the co-line with respect to the arbitrarily specified pixel 
( in the survey region A in the embodiment ) , and by searching 
for an object point which matches image coordinates calculated 
from these surveyed coordinates with image coordinates of the 
specified pixel, the survey of the object point corresponding 
to the arbitrary pixel on the survey image can be automatically 
conducted . 
[0039] 

Details of the automatic survey processing operations of 
the embodiment are explained with reference to Fig. 8 through 
Fig. 11. 

[0040] 

Fig. 8 is a flowchart of the program of the whole of the 
automatic survey processing operations, and the program is 
executed by the CPU 41. The automatic survey processing 
operations of Fig. 8 are performed after the single photograph 
orientation processing for the survey image is finished, and 
the external orientation elements and internal normal position 
elements of the digital still camera 20 when it takes the survey 
image are determined in advance. At Step S301, a survey region 
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A determined on the survey image of the monitor 45 by the operator 
with a mouse 43 is acquired, and pixel numbers (1 through N, 
N: total number of pixels in the survey region A) are assigned 
to all pixels in the survey region A. 
[0041] 

. AtStepS302, thepixelnumber iis setto 1, and the processings 
of Step S303 through Step S306 are repeated until i reaches 
N. Namely, at Step S303, a survey is automatically made by the 
surveying instrument 10 along a co-line of image coordinates 
(Xi', yi') corresponding to the pixel number i, and image 
coordinates corresponding to the measured survey coordinates 
are compared with image coordinates ( xi ' , yi ' ) of the pixel number 
i, whereby the position of an object point corresponding to 
the pixel of the pixel number i is searched and surveyed (object 
point search processing) • The details of the object point search 
processing are explained later. 
[0042] 

At Step S304, survey data with respect to the pixel (xi', 
yi') detected by the object point search processing of Step 
S303 is recorded on the recording medium 42, etc. At Sep S305, 
it is judged whether the pixel number i is larger than the total 
pixel number N. Namely, it is judged whether the project point 
search processing has been finished for all pixels in the survey 



i 



region A. When it is judged that i is not larger than i is 
incremented by 1 at Step S306, and the process returns to Step 
S303 again. On the other hand^ when it is judged that i is larger 
than N/ this automatic survey processing operation is ended. 
[0043] 

Fig. 9 is a flowchart of the details of the object point 
search processing of Step S303. At Step S401, a unit co-line 
vector (rix/ riy, riz) on a co-line LNc corresponding to image 
coordinates (xi', yi') is calculated (unit co-line vector 
calculation processing) . In the object point search processing^ 
a survey is made by collimating the surveying instrument 10 
to virtual collimation points Rj on the co-line LNc arranged 
at predetermined intervals. At Step S402, a distance L from 
the camera coordinate origin be (Xo^ Yof Zo) with respect to 
the virtual collimation points Rj on the co-line LNc is set to 
an initial distance La. 

[0044] 

At Step S403, from the unit co-line vector (rix, riy, riz) 
calculated at Step S401 and the distance L, survey coordinates 
(XRj, Yr^^ ZRj) of virtual collimation points Rj are calculated 
by the following equations: 
XRj=Xo+rix • L 
YRj=Xo+riy • L 
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ZRj=Xo+riz • L (6) 

and horizontal angles 9h and elevation angles Op for collimating 
the collimating telescope 17 to the virtual collimation points 
Rj are calculated by the following equations (7) and (8). . 
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[Numerical formula 7] 
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As shown in Fig. 10, in the equations (7) and (8), the origin 
of the survey coordinate system is at the collimation origin. 
Os, and when ep=eh=0, the X axis matches the horizontal axis 
Lh, the Y axis matches the vertical axis Lp, and the Z axis 
matches the collimation line (optical axis) LNq. In this case, 
the surveying instrument 10 directs the collimation line 
(optical axis) LNo of the collimating telescope 17 toward (6h, 
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Bp) based on a signal instruction from the computer 40. 
[0045] 

At Step S404, a survey is conducted in the collimation 
direction of Step S403 . Based on survey data of the object point 
Qi corresponding to the virtual collimation point Ri surveyed 
in actuality by the survey, the survey coordinates (Xqi, Yqi, 
Zgi ) are calculated . At Step S 405 , image coordinates of the object 
point Qi (XQi'z Yqi') corresponding to the survey coordinates 
(Xgi, Yqi, Zqi) of the object point Qi are calculated by using 
the external orientation elements (Xor Yo, Zo/ o), ^, k) and 
internal norma J. position elements (f, D2/ D4/ De, Ni, N2, Xc^ 

Yc). 

[0046] 

At Step S406, it is judged whether the image coordinates 
(XQi ' , yQi ' ) corresponding to the object point Qi match the image 
coordinates (Xi', yi') of the co-line LNc. For example ^ when 
the distance between the image coordinates (Xgi' , Yql' ) and the 
image coordinates (Xi', Yi ' ) is within a predetermined value, 
it is judged that the image coordinates ( x^i ' , ygi ' ) corresponding 
to the object point Qi match the image coordinates (Xi', Yx' ) 
of the co-line LNc- In this case, at Step S407, the calculated 
survey coordinates (Xgi, Ygi / Zgi) of the object point Qi are 
set as survey coordinates corresponding to the pixel (Xi' , yi' ) 
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of the pixel number and then the object search processing 
is ended. On the other hand, when it is judged that they do 
not match each other, at Step S408, the distance L is updated 
to L+AL, and the processings of the step S403 and subsequent 
steps are repeated. AL is an increment amount of the distance 
L, and is determined depending on the measurement accuracy and 
measuring time. 
[0047] 

Next, with reference to Fig. 11, unit co-line vector 
calculation processing to be executed at Step S401 is explained. 
Fig. 11 is a flowchart of the unit co-line vector calculation 
processing. 

[0048] 

In the embodiment, the unit co-line vector is calculated 
by using the least squares method. Namely, in the unit co-line 
vector calculation processing of the embodiment, an arbitrary 
unit vector (rcix^ rciy/ rciz) is set as an approximate unit co- line 
vector with respect to the pixel (xi' , yi' ) , and at Step S501, 
image coordinates (Xgi', Ygl' ) corresponding to the survey 
coordinates (Xo+rcixr Yo+rciyf Zo+rciz) indicated by the end of 
the unit vector (rcix/ rciy/ rciz) starting from the camera 
coordinate origin Oc (Xo, Yo, Zo) are calculated from the equations 
( 1) through (4) by using the external orientation elements (Xo, 
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Yof Zo/ CO/ <(>/ k) and internal normal position elements (f^ D2, 
D4, De, Ni, N2/ Xcr Yc). 
[0049] 

At Step S502, a merit function <I> = (xi'-Xgi' )^+(yi'-yGi' )^ with 
respect to the image coordinates (Xci/ Yqx, Zgi) calculated at 
Step S501 is calculated. At Step S503/ it is judged whether 
the value of the merit function <I> is smaller than a predetermined 
value. When the value of the merit function O is judged as being 
smaller than the predetermined value ^ the unit vector (rcix/ 
rciyf rciz) is set as the unit co-line vector (rix/ riy^ riz) with 
respect to the pixel of the pixel number i at Step S504, and 
the unit co-line vector calculation processing is ended. 

[0050] 

On the other hand, at step S503, when it is judged that the 
merit function 4> is not smaller than the predetermined value, 
correction amounts (Srix/ 6riy, Sriz) for the unit vector (rcix/ 
rciy/ rciz) approximately provided at Step S505 are determined 
by, for example, the least squares method. The approximate unit 
vector is updated to the unit vector (rcix+Srix/ rGiy+6riy, rciz+Sriz) • 
Thereafter, the process returns to Step S501, and Steps S501 
through S505 are repeatedly executed until <I> is judged as being 
smaller than the predetermined value at Step S503. 

[0051] 
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The capacity/ etc. , of the survey region are calculated from 
the survey data of the survey region obtained by the automatic 
survey processing operations. It is also possible that only 
the outer periphery of the specified survey region is 
automatically surveyed to calculate the area and outer 
peripheral lengthy etc./ of th.e survey region. 

[0052] 

As described above, according to the embodiment, a survey 
point specified on the survey image can be collimated by using 
the surveying instrument and automatically surveyed. In a 
surveying instrument 10 having a CCD inside, although this is 
not shown, a survey point is roughly collimated by the surveying 
instrument 10 in response to an instruction from the survey 
image, control is performed so that the hair center comes to 
the point specified on the CCD image inside the surveying 
instrument 10 at a magnification higher than the survey image, 
whereby detailed collimat ion can be performed . In the embodiment , 
by determination of a survey region on a survey dLmage by an 
operator, the surveying instrument can automatically conduct 
the survey within the region, so that the survey working 
efficiency is remarkably improved. 

[0053] 

When a lens with a long focal length such as a telephoto 
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lens is used for taking a survey image ^ distortion as one of 
the internal normal position elements is small, and is 
substantially ignorable in some cases. Namely, among the 
internal normal position . elements, (D2/ D4, De, Ni, N2) are 
ignorable, and unknown internal normal position elements are 
only (f, Xc, Yc). To calculate the internal normal position 
elements (f, Xc, Yc), five or more reference points Pi 
three-dimensionally arranged are sufficient. When the 
eccentricity of the principal point from the image center can 
be ignored and distortion asymmetrical components and 
distortion fourth-order and sixth-order components can be 
ignored, the internal normal position elements to be calculated 
are ( f , D2 ) / and four reference points are sufficient for internal 
orientation. As described above, when the number of internal 
orientation elements to be calculated is small, the number of 
reference points for internal orientation can be reduced, and 
this reduces the measuring labor and time. 
[0054] 

In the embodiment, explanation is given by assuming that 
the digital still camera 20 is arbitrarily disposed with respect 
to the surveying instrument 10, however, it is also possible 
that the digital still camera 20 is disposed at a position 
optically equivalent to the collimating telescope 17 of the 



surveying instrument 10 by providing, for example, a tool for 
attaching the camera to the surveying instrument 10, and in 
this case, the number of unknown external orientation elements 
can be reduced, so that the number of reference points can be 
reduced • When the digital still camera 20 is disposed at a 
position optically equivalent to the collimating telescope 17 
of the surveying instrument 10 and takes a survey image (when 
the projection center of the imaging optical system of the image 
pickup device is disposed at a position optically equivalent 
to the collimation origin of the collimating telescope), the 
horizontal angle and elevation angle can be directly calculated 
from image coordinates, and the processing becomes simple. 
[0055] 

Hereinafter , a modified example when the digital still camera 
20 is disposed at a position optically equivalent to the 
collimating telescope 17 is explained with reference to Fig. 
12. In this case, among the external orientation elements (X©, 
Yo, Zo, CO, <|), k) , Xo=Yo=Zo=0. When the axis y' of the camera image 
coordinate system is disposed so as to correspond to the 
horizontal axis Lh of the surveying instrument 10, the survey 
coordinate system and the camera coordinate system are judged 
as identical to each other, so that when the surveying instrument 
10 is collimated to an arbitrary survey point Pn within a survey 
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image (see Fig. 6) , fromthe horizontal angle Oho and the elevation 
angle 6po as the initial collimation direction when taking the 
survey image ^ horizontal angle 6hn and elevation angle 0pn of 
the survey point Pn collimated in the surveying instrument 10^ 
and image surface distance f of the. imaging lens 22 (internal 
normal position elements are also used when distortion 
correction is necessary) , the position (xpn' / yPn' ) of the image 
point Pn' corresponding to the survey point Pn can be directly 
calculated as foilows: 
xpn'=f • tan( .hn-.ho) /Px+w/2/ 
ypn'=f • tan( .pn-.ao)/Py+H/2. (9) 

Therefore, when a collimation position (xpn' , yPn' ) is specified 
on the survey dLmage, the horizontal angle 6hn and elevation 
angle 8pn of the survey point Pn can be calculated reversely 
from the equation (9) as shown below, and collimation can be 
made by directing the surveying instrument 10 toward these 
angles . 

.hn=tan"^(Px(xpn'-W/2) /f )+ .ho 
.pn tan-'(Py(ypn'-H/2)/f)+ .po.(lO) 
[0056] 

Fig. 12 is a flowchart of working procedures in this case. 
First, in Step S601, the survey image and the survey 
coordinates are associated with each other by the single 
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photograph orientation processing of Fig. 2. At Step S602^ for 
example, a survey point Pn is specified as a collimation point 
on the survey image by using the mouse 43, etc., (see Fig. 6), 
and a collimation mark is indicated at the specified position 
to indicate the collimation position. At. Step S603, a position 
Pn ' ( xpn ' , xpn ' ) on the survey image of the specified collimation 
point (survey point Pn) is substituted into the equation (10) 
to calculate collimation angles (6hn/ 6pn)/ and collimation is 
made by directing the surveying instrument toward these. At 
Step S604, the indication of the collimated collimation point 
is changed (changed in color, shape, or size) and indicated 
on the survey image, and then the survey operation is ended. 
[0057] 

According to the modified example, an operator can visually 
confirm on the survey image that the collimation has been 
finished, and this further improves the collimating 
operability . 

[0058] 

As another modified example, survey operations when 
three-dimensional position data of the survey point to be 
collimated has already been known as design values such as a 
survey set point, or when three-dimensional position data of 
the collimation point has already been known as in the case 
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where a survey point that was surveyed once (three-dimensional 
data has been detected) is collimated again, are explained. 
When three-dimensional data of a survey point Pn to be collimated 
is known, it is also possible that the coordinates (Xn, Yn, Zn) 
of the survey point Pn are substituted for the Ri (Xri, Yri, Zri) 
in the equations (7 ) and ( 8 ) to calculate the horizontal angle 
6hn and the elevation angle 6pn of the survey point Pn, and 
collimation is automatically made. Fig. 13 is a flowchart of 
operation procedures in this case. 
[0059] 

At Step 8701, the survey image and the survey coordinates 
are associated with each other by the single photograph 
orientation processing of Fig. 2. At Step S702, a survey point 
(for example, a survey set point) whose three-dimensional 
coordinates are known is indicated on the survey image. An 
operator determines a collimation direction by instructing the 
survey point to be collimated on the survey image by using a 
pointing device such as the mouse 43 on the survey image. At 
Step S7 04, by substituting the three-dimensional coordinates 
of the specified survey point Pn into the equations (7) and 
(8), the collimation angles (Ohn, Opn) are calculated, and the 
surveying instrument is collimated toward these. At Step S705, 
the indication of the collimated survey point on the survey 
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image is changed (in color, shape, or size), and this survey 
processing is ended. 
[0060] 

Also in the modified example, the oper ability can be improved 
approximately as in the case of the above-described modified 
example since the end of collimation can be visually confirmed 
on the survey image. It is also possible that the indication 
mark of the survey point selected when instructing the survey 
point at Step S703 can be changed. In the case where a survey 
set point is used as the survey point, when the design coordinate 
system of the survey set point does not match the survey 
coordinate system of the survey site, the values of the survey 
set point in the design coordinate system are converted into 
values in the survey coordinate system. The reverse is also 
possible. 

[0061] 

In the embodiment, a surveying instrument is directed toward 
a collimation point Ri on a co-line LNc with respect to a certain 
pixel, and survey coordinates (Xqi, Yqi, Zqi) measured in this 
case are converted into image coordinates (Xqi', Yqi' ) of the 
survey image, and it is judged whether the image coordinates 
match the original pixel image coordinates (xi' , yi' ) / however/ 
it is also possible that this judgement is made by judging whether 
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the survey coordinates (XQi^ Yqi^ Zqi) and the survey coordinates 
(Xri, Yri, Zri) of the collimation point Ri match each other. 
[0062] 

In addition, in the embodiment, reference points are 
arbitrarily specified on a survey image by using a pointing 
'device, however, it is also possible that a reference scale 
with known dimensions or reference marks that can be arbitrarily 
arranged are disposed in the image-taking range, and these are 
defined as reference points to determine external orientation 
elements. In this case, positions on the reference scale and 
reference marks are selected on the survey image by using the 
pointing device, etc. When the reference scale or reference 
marks are used, the positions of the reference points on the 
survey image can be automatically detected by using , for example , 
image processing. 

[0063] 

In the embodiment, the computer connected to the surveying 
instrument is used, however, it is also allowed that the 
surveying instrument or digital still camera is integrally 
provided with the functions of the computer of the embodiment. 
In the embodiment, a digital still camera is used, however, 
a video camera, etc., can also be used as long as a digital 
image can be obtained with the surveying instrument. 
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[0064] 

[Effects of the Invention] 

As described above, according to the invention, survey 
working efficiency can be improved. Furthermore, according to 
the invention, survey . data obtained by a surveying instrument 
and image data obtained by a camera are easily and efficiently 
associated with each other, and automatic surveys based on the 
image data can be conducted • 
[BRIEF DESCRIPTION OF THE DRAWINGS] 

[ Fig • 1 ] is a block diagram generally showing the construction 
of the survey system of an embodiment of the invention; 

[Fig. 2] is a flowchart of single photograph orientation 
processing in the survey system of the embodiment; 

[Fig. 3] is a drawing conceptually showing the arrangement 
of the surveying instrument and the camera in the survey system 
of the embodiment; 

[Fig. 4] is a drawing schematically showing the relationship 
between three reference points Pi, P2, and P3 and image points 
Pi', P2 ' f and P3' at the imaging surface S; 

[Fig . 5 ] is a flowchart of the program of the spatial resection 
backward intersection method for calculating the external 
orientation elements (Xo/ Yo^ Zof co, 4/ k) and camera internal 
normal position elements (f, D2, D4, De, Ni, N2, Xc, Yc) indicating 
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the position and inclination of the digital still camera; 

[Fig. 6] is an example of a survey image when a survey region 
is determined; 

[Fig. 7] is a drawing for generally explaining the principle 
of automatic survey of the embodiment; 

[Fig. 8 ] is a flowchart of the program of the automatic survey 
processing operations of the embodiment; 

[Fig. 9] is a flowchart of object point search processing 
to be executed at Step S303 of Fig. 8; 

[Fig. 10] is a drawing showing the relationship between the 
collimating telescope and a survey coordinate system of the 
surveying instrument; 

[Fig. 11] is a flowchart of unit co-line vector calculation 
processing to be executed at Step S401 of Fig. 9; 

[Fig. 12] is a flowchart of operation procedures in the 
modified example in which the digital still camera is disposed 
at a position optically equivalent to the collimating telescope ; 
and 

[Fig. 13] is a flowchart of operation procedures when a 
horizontal angle Ohn and an elevation angle Opn of a survey point 
Pn are calculated based on coordinates (Xn/ Yn, Zn) of the survey 
point Pn and a survey is automatically made. 

[Description of Symbols] 
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[TITLE OF DOCUMENT] ABSTRACT 
[ABSTRACT] 

[OBJECT] To conduct an automatic survey of a point or region 
specified on a survey image of a survey site, 
[ SOLVING MEANS ] A pixel (or region) to be surveyed is specified 
on a survey image taken by a digital still camera 20. A co-line 
LNc that regulates collinear conditions witli respect to the 
specified pixel is calculated from external orientation 
elements of the survey image for a surveying instrument 10. 
Acollimation line (collimation direction) LNo of the surveying 
instrument 10 is moved along the co-line LNc and the surveying 
instrument 10 is collimated to a collimation point (Ri, R2...) 
on the co-line LNc to conduct a survey. A position of an object 
point Qi measured when a survey is conducted toward the 
collimation point Ri is measured. When the position of the object 
point Qi is a point on the co-line LNc/ the object point Qi is 
regarded as an object point with respect to the specified pixel 
on the survey image . When a region is specified, these operations 
are performed for each pixel in the region. 
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